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PROCESSING OF DI GITAI PfHTI IPP rAta m a pgcoDEn 



The present invention relates to a decoder for a digital audiovisual transmission system, the decoder 
comprising a processor means for decompressing and displaying compressed digital picture data and 
a memory means. 

Broadcast transmission of digital dat^ is-well known in the field of-pay TV-systems, where scrambled 
audiovisual information Is sent, usually by a satellite or satellite/cable link, to a number of subscribers, 
each subscriber possessing a decoder capable of descrambling the transmitted program for 
subsequent viewing. Terrestrial digital broadcast systems are also known. Recent systems have 
used the broadcast link to transmit other data, in addition to or as well as audiovisual data, such as 
computer programs or interactive applications. 

In the most basic level of functionality of such systems, digital audio and video data relating to the 
televised program is transmitted in a compressed format, for example, in accordance with the MPEG-2 
compression standard. The decoder receives and decompresses this data in order to regenerate the 
televised program. 

In addition to cimplc televised program data, it is becoming incrtfasiiigly common for the decoder to be 
rftqnir*=rl tn handle other compr©cc©d imago or graphio datq. for example, in the CdA6 wl ici e Llic 
decoder includes web browser capabilities, the processor of the decoder may be required to receive 
and decompress downloaded digital picture data, for example, stiil video pictures, graphic icons, 
moving- computer generated images etc. This picture information may be displayed over the normal 
televised program images. 

Such still or moving picture data may be typically received in one of any number of compressed 
formats that are currently used in the context Of. PC based web browsers. For example, a picture may 
be formatted and compressed according to the well-known GIF or PNG standards, where an image Is 
described by a colour look-up table defining a table of colours and a matrix of pbcel values referring to 
this table, the matrix data being compressed according to a known compression procedure to prepare 



.PEG ,..ge, in „nich ea* pixel is d.eCy .ssp^,« , «*,™sn,.,u. =«,„u, value. 

5 picture files. 



Acccdin, .0 p.se„, i„.e„„o„, ,^„e . p.,«.d a .e».e, a c^ita, audiovisual .a„=.i..io„ 
=...e.. decode, ccprlsin, a pnoces., .ea„3 deo=^p.s.n, and disp^vlng co^p^easM 
d,a„a, pio^re d„a and a memo^ ™an>, characlerisad In »,a, »,e .a.o^ ^an. c=™p..as a 
10 ..crage allooateo ,o receive decompressed dlgi,al i.age da^ ^ p^,,„ ^,„3 

a. ,ea« one display n,en,co- readable by .be p^cesso, means ^or ,o display, data being copied fronn 
the storage memo;y to Ihe display memory for subsecuenl display. 

■n>i= division Of memo^ means ,n» a storage and display memory areas introduces a deg,,e of 
.B «exibili.y into the display o, image data, ,„ particular by permitting Image data to be beid 
contemporaneously in the storage and display means. 

Ih some instances, decompressed ithage data may simply be copied "as is- into the display memoo- 
However, in some cases, the digital Image d«a copied from the storage memory into the display 
memory is n»dified or duplicated duhng me copying step, for example, in order to res^e the digital 
.mage or to copy the same image a rrumber of Umes into Ihe display memory. 

Preferably, the processor means Is adapted to process Image data ,h the display memory as one layer 
amongst a plurality of layers superimposed one oyer the other »hen displayed. 

AS discussed above, piotore data may be supenmposed in a higher layer over, tor example 
audrovisual in,om,ation represenCng non^al tolevlsed images. However, in one embodiment the 
.mage data in the display memo^ may be displays, in a layer nonnally used by the processor means 
to disp^ broadcast audiovisual ,„,i^a«on. This may be the case. ^ example, where the decoder 
s^tches from a -tolevision- mode, ,„ which a broadcast emission . displayed, to a -web br^er 




mode, in which downloaded picture data from the internet is displayed in place of normal televised 
programmes. 

Advantageouslyr-the memory means comprises a second display memory readable by the graphic 
processor means and corresponding to a second layer of displayed image data, data being copied 
from the storage memory to the second display memory for subsequent display in the second layer of 
image data. 

Again, as before, the digital Image data copied from the storage memory to the second display 
memory may be modified during the copying step. 

In one embodiment, for example, where the decoder switches between a television and browser 
mode, the image data in the second display memory may be displayed in the lowermost background 
layer normally used by the processor means to display broadcast still audiovisual infonmation. 

Preferably, partial image data is copied from the storage memory to a display memory under the 
control of an application running within the decoder so as to permit display of part of an image. This 
may be desirable, for example, where the decompression and downloading of an image into the 
storage memory by the processor proceeds in a number of stages. 

in one embodiment, Image data is copied from the storage memory into a first or second display 
memory under control of a high level application njnning on the processor means. Alternatively, this 
process may be handled automatically by a lower level application associated for example with the 
general handling of received image data. 

Compressed digital picture data is preferably stored in a buffer memory means prior to decompression 
by the processor means. It is not necessary that this buffer means be a single integral block of 
memory particularly if the data arrives in a number of blocks of information. In particular, in one 
embodiment, the buffer means comprises a plurality of buffer memory elements. Each memory 
element may correspond, for example to a block of data downloaded in the decoder. 
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^moT, Ihe end of me Oecon,pr..s»n of eh. contents of eaoh buffer element. 



over a 



10 image 



i. may be me <^se, for e«.p,e. ,ha. Infcrmatta oo^spondin, ,o one ^ege w« be spread 
number of buffer elements. As ea* buffer a^pffed and decompressed, me ,nfonna«cn ready for 
d.p.ay . ^n^ferred Immediately .o me d.p,ay .emory, enabling a partial display of me complete 
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in addition, or a,t.n,at,ve.y. m, decon,pres=,o„ and ^nsfer of a group of images In a single image «le 
f^om the buffer memory means to me storage memory, and irom me storage memory to a display 
memorv, i. ,„ntroi,ed by me processor means sucn ma, image lnfom,at,o„ is transferred ,™m me 
storage memory « me display memc^ a. me end o, me d.c^press»„ of each ^age ,„ me Image 
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AS discussed above. Image data may be sen, h any number of ,om,ats. In one embodiment, me 
processor Is adapted to decompress picture data sent In a compression standard, such as GIF or 

20 PNG, that u?^ a colour fook-up table. 

in addition or altema^vely. me processor Is adapted to decompress picture data so,, in a oomprasaion 
s^ndard. aucn MPEG or JPEG, .hat uses a red/biue/green colour value associated wim «,ch pixel. 

2= The processor means in the decoder need not necessary be embodied in a single ^ip but may be 
d.vlded. for example, mto a processor fr. decompression and a graphs processor for preparing me 
decompressed data for display. 



The present invention has been discussed above in relation to a decoder apparatus. The present 
invention equally extends to a method of digital image processing within a decoder, and con-esponding 
to the general and preferred aspects of the invention discussed above. 

In the context of the present application the tenn «digital audiovisual transmission system» refers to all 
transmission systems for transmitting or broadcasting primarily audiovisual or multimedia digital data. 
Whilst the present invention is particularly applicable to a broadcast digital television system, the 
present invention may equally be used in filtering data sent by a ftxed telecommunications network for 
multimedia internet applications etc. 

Similarly, the term "decoder" is used to apply to an integrated receiver/decoder for receiving and 
decrypting an encrypted transmission, the receiver and decoder elements of such a system as 
considered separately, as well as to a receiver capable of recervrng non-encrypted broadcasts. The 
term ftqiially nnvpr*; rlproder« including additional funotiono, auch web browscri. tuyetliei wUh 
decoders integrated with other devices, for example, integrated VHS/decoder devices, digital 
televisions, or the like. 

The term MPEG refers to the data transmission standards developed by the International Standards 
Organisation working group "Motion Pictures Expert Group*' and notably the MPEG-2 standard 
developed for digital television applications and set out in the documents ISO 13618-1, ISO 13818-2, 
ISO 13818-3, and ISO 13818-4. In the context of the present patent application, the term includes ail 
variants, modifications nr devftlnpmpnts of the b^clc MPEG formoto applicable to the field of Jlyiltal 
data transmission. 

There will now be described, by way of example only, a prefen^ed embodiment of the present 
invention, with reference to the attached figures, in which: 

Figure 1 shows an overview nf a riroit?=il tplpvi?ion syctgm; 

Figure 2 shows the elements of the receiver/decoder of Figure 1; 



JTy . AD 



Figure 3 shows a block diagram of the 



computer system of the receiver/decoder 



Figure 4 Shows in layer form the image data 



processed by the graphic processor of Figure 2; 



Figure 5 shows the operations earned out i 



layer of Figure 4; and 



-n memory for picture data to be displayed in the MPEG 
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MPEG layer. 

A. ove^law „, , , ^ ^^^^^ ^ ^^^^ ^ ^^^^ ^ ^ 

— i„c,u.^ , ,„^„„„„^ ^ ^_ ^^^^^ 

co^procCoo o^.. . ^.,„„ ,^ ^ ^^^^^^ ^ ^ ^ 

broadca., ^ 3 ^ ^ ^^^^ ^ ^ ^ 

oonneolHJ to a multiplexer and scramblers by linkage 5. 



t 



20 



—I., compre^ed dl,« si.„,„ ,0 e ^n.mi„er 6 pr „e broadca« =en.e llnKpg. 7. .vMp. can o, 
cpp:^ «e , «.de vane^ « ,„mns ,=l^n,™„ica«^ , 

e,ec.e.a,ne«c 3^„a,= via „pr« 3 loward. a sa,^,|^ ^^ppnd. e. wHere mey a. .^„^y 
processed and broadcas, vie no,^„a, downllnK ,0 .o ear« .ce.ar ,2. conventionally ,n ^e form or a 
owned or ranted by tba end .er. ^ si„s recetved by ™ceK.r ,2 a. .ns.^ ^ 
..e^tad recelver^daccdar ,3 owned or .„,ed by ^ end user and connected to .e end users 
«..S.n sa. ,4. 7.. ,«,..r«ec«er „ d«pd« .p ^ 
Signal for the television set 1 4. 
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Other transport channels for transmission of the data ar^ nf nr. 

^ "^^^ possible, such as terrestrial broadcast 

cable transniission. combined satellite/cable links, telephone networks etc. 



In a mulUchannel system,"the multiplexer 4 handles audio and video infonmation received from a number 
of parallel courcoc and intcracta with the ti-ciri^i i liuci e lu Uroadcasi the (nrormanon along a con-esponding 
number of chfinnels. in addition to audiovisual infomnation, messages or applicaliorn> or any other sort of 
digital data may be introduced In some or all of these channels interiaced with the transmitted digital audio 
and video information. 

A conditional access system 15 is connected to the multiplexer 4 and the receiver/decoder 13, and is 
locatftd partiy in th* broadcaKt centre and portly 'm the decoder. It enables Uie t?nd user to access digital 
television broadcasts from one or more broadcast suppliers. A smartcard. capable of deciphering 
messages relating to commercial offers (that is, one or several television programmes sold by the 
broadcast supplier), can be inserted into the receiver/decoder 13. Using the decoder 13 and smartcard. 
the end user may purchase commercial offers in either a subscription mode or a pay-per-view mode. 

As mentioned above, programmes transmitted by the system are scrambled at the multiplexer 4. the 
conditions and encryption keys applied to a given transmission being determined by the access control 
system 15. Transmission of scrambled data in this way is well known in the field of pay TV systems. 
Typically, scrambled data is transmitted together with a control word for descrambling of the data, the 
control word Itself being encrypted by a so-called exploitation key and transmitted in encrypted form. 

The scrambled data and encrypted control word are then received by the decoder 13 having access to 
an equivalent of the exploitation key stored on a smart card Inserted In the decoder to decrypt the 
encrypted control word and thereafter descramble the transmitted data. A paid-up subscriber will 
receive, for example, in a broadcast monthly ECM (Entitlement Control Message) the exploitation key 
necessary to decrypt the encrypted control word so as to permit viewing of the transmission. 

An interactive $y5tem 16, also mnnected to the multiplexer 4 and the rGoeiver/decoder 13 and again 
located partly in the broadcast Qf ntre and oadly inJtu=ujennrter. enables the end uccr to interact with 
various applications via a modem back channel 17. The modem back channel may also be used for 
communications used in the conditional access system 15. An interactive system may be used, for 
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example, lo vable the viewer to connmunioate .mmediately wrth the transmission centre to den.an. 
authorisation to watch a particular event, download an application etc. 

Referring to Figure 2. the elements of the receiver/decoder 13 or set-top box adapted to be used in the 
present Invention will now be described. The elements shown in this figure will be described in tenr,s 

of functionai blocks. 



.ne aecoder 13 comprises a central processor 20 induding associated memoo' elements and 
adapted to receive input data from a serial Interface 21. a parallel interface 22. a modem 23 
10 (connected to the modem back channel 17 of Fig 1). and switch contacts 2. on the front panei of the 
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The decoder is additionally adapted to receive inputs from an infra-red remote control 25 via a control 
unit 26 «nd cloo poooc«ca two »m..t«„u ...Uc. 2T. « adapted to reaa oanK or subscnption 
smartcards 29. 30 respeCvely. The subscription smartcard reader 28 engages with an inserted 
subscription card 30 and with a conditional access unit 29 to supply the necessary control word to a 
riBmultipleyer/descramblBr 30 to «n.hln thn nnnryr,f.d hr.*dc«t .igna, to bo duooromblod. Th* 
decoder also includes a conventional tuner .31 «nd ripmodulato. 22 to r^c^lvo and domoduloto the 
satellite transmission before being filtered and demuitiplexed by the unit 30. 

Processing of data within the decoder is generally handled by the central processor 20. The software 
architecture of the central p. ou.».or^rresponds to a vinua. machine interacting via an interface layer 
With a lower level operating system implemented in the hardware components of the decoder. THis 
will now be described with reference to Figure 3. 

For the purposes of this description, an application is a piece of computer code for controlling high 
level functions of the receiver/decoder 13. For. example, when the end user positions the focus of a 
remote controller on a button object seen on the screen of the television set and presses a validation 
key, the instrucOon sequence associated with the button is i 



run. 



An interactive application proposes menus and executes cx)mmands at the request of the end user 
and provides data related to the purpose of tho application. Applications may be either resident 
applications, that is. stored in the ROM (or FLASH or other non-volatile memory) of the 
receiver/decoder 13, or broadcast and downloaded into the RAM or FLASH mftmnry of tha 
receiver/decoder 13. 

Applications are stored in memory locations in the receiver/decoder 13 and represented as resource 
flies. The resource files comprise graphic object description unit fries, variables block unit files, 
instruction sequence files, application files and data flies. 

The receiver/decoder contains memory divided into a RAM volume, a FU\.SH volume and a ROM 
volume, but this physical organization Is distinct from the logical organization. The memory may 
fijrther be divided into memory volumes associated with the various interi'aces. From one point of 
view, the memory can be regarded as part of the hardware; from another point of view, the memory 
can be regarded as supporting or containing the whole of the system shown apart from the hardware. 

Referring to Figure 3. the computer system can be regarded as centred on a run time engine 40 
forming part of a virtual machine 41. This is coupled to applications on one side (the "high lever side), 
and, on the other side (the "low level" side), via various intermediate logical units discussed below, to 
the receiver/decoder hardware 42. The receiver/decoder hardware can be regarded as including 
various ports corresponding to the functional blocks discussed in relation to Figure 2 (the interface 26 
for the handset 25. the MPEG stream Interface 30, the serial interface 21. the parallel interface 22. the 
interfaces to the card readers 27, 28, and the interface 23 to the modemmed back channel 17). 

Various applications 43 are coupled to the virtual machine 41. Some of the more commonly used 
applications may be more or less pennanently resident in the system, as indicated at 44, while others 
will be downloaded into the system, eg from the MPEG data stream or from other port? as required. 



The virtual machine 41 includes, in addition to the run time engine 40. some resident library functions 
45 which include a toolbox 46. The library contains miscellaneous functions in C language used by 
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the engine 40. These include data 
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t 



maniputetior s.* as compression, expansion or pomparlson of 
da. s,™c,„as, iin, .ra.„, ^^^^ ^^^^^ ^^^^ ^^^^^ ^^^^^ ^ 

.he .r^ware o, .na race.ar,.aoo.ar, s.. as an. so^a vers^n „„.Pars ano ava«aOia 

space, and a Wion osed „Han oo^ioa*, a new device 47. P„„c«ons can ba downioaded 
into the library and stored in FUSH or RAM memoiy. 

THe n.n tinne ens'.e 40 is coupled to a da^ce manager 48 which coupled to a se, „, devices 47 
Which are coupled to Cevioe drive. 49 wh^ are in ,.m coupled ,o the po«s or interfeces in broad 
.e-ms, a device driver can be regarded as deflning a logical interface, so U,a, two different device 
dnvers may be coupled to a common physical pc. a device will normally be coapied to more than 
one device dHven it , device is coupled .0 a single device dhver, the device will nom^ily be designed 
to inccn^crat. the full functionality required tor communication, so tha, the need for a separate devic, 
driver is obviated. Certain devices may communicate among themselves. 



15 AS will be described below, there ar. three fcm,s of communica«on from the devices 47 up to the run 
time engine: by means of variables, buffers, and events which are passed to a set of event queues 
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Each function of the recelver/deooder is represented as a device 47. Devices can be either local or 
remote. Local devices include smerk=erds, SOART connector signals, modems, sertal and parallel 
interfaces, a MPEG v,deo and audio player and an MPEG section and table e«ractor. Remote 
devices executed in a remote location, differ ffom iocal dev«:es in that a port and procedure must be 
de.„ed by the system au»»h^ or designer, rather than by a device and device driver provided and 
designated by the receiver/decoder manufacturer. 

The run time engine 40 nrns under ^e cont™i of the microp^cessor and a common application 
programming interface. They are installed in eve^ rece.er/d.coder so that all .«eiver/d.code« are 
•dentical frgm the application point of view. 
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The engine 40 runs applications 43 on the receiver/decocler, (t executes interactive applications and 
receives events from outside the receiver/decoder, displays graphics and text, calls devices for 
services and uses functions of the library 45 connected to the engine 40 for specific computation. 



The njn time engine 40 is an executable code installed in each receiver/decoder, and includes an 
interpreter for interpreting and running applications. The engine is adaptable to any operating system, 
including a single task operating system (such as MS-DOS). The engine is based on process 
sequencer units (which take various events such as a key press, to carry out various actions), and 
contains its own scheduler to manage event queues from the different hardware interfaces. It also 
handles the display of graphics and text A process sequencer unit comprises a set of action-groups. 
Each event causes the process sequencer unit to move from its current action-group to another 
action-group in dependence on the character of the event, and to execute the actions of the new 
action-group. 



The engine 40 comprises a code loader to load and download applications 43 into the 
receiver/decoder memory. Only the necessary code is loaded into the RAM or FLASH memory, in 
order to ensure optimal use. The downloaded data is verified by an authentication mechanism to 
prevent any modification of an application 43 or the execution of any unauthorized application. The 

angina AO further compriooo a. dooompreoder. tl-ic ai^^\'iK^cLl\\jn i^uJo (a fuim vr fdlei uieUIcdCe uuue^) lis 

compressed for space saving and fast downloading from the MPEG stream or via a built-in 
receiver/decoder mode, the code must be decompressed before loading it into the RAM. The engine 
40 also comprises an Interpreter to interpret Ihe application code to update various variable values 
and determine status changes, and an error checker. 

Before using the services of any device 47, a program (such as an application instruction sequence) 
has to be declared as a "client", that is, a logical access-way to the device 47 or the device manager 
45. The manager gives the client a client number which is referred to in all accesses to the device. A 
device 47 can have several clients, the number of clients for each device 47 being specified 
depending on the type of device. A client is introduced to the device 47 by a procedure **Devlce: Open 
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Channel-. TTiis procedure assigns a client number to the client. A client can be taken out of the 
device manager 48 client list by a procedure "Device: Close Channel". 

The access to devices 47 provided by the device manager 48 can be either synchronous or 
asynchronous. For synchronous access, a procedure "Device: Call" is used. This Is a means of 
accessing data which is immediately available or a functionality which does not involve waiting for the 
desired response. For asynchronous access, a procedure "Device: I/O" is used. This is a means of 
accessing data which involves waiting for a response, for example scanning tuner frequencies to find 
a multiplex or getting back a table from the MPEG stream. When the requested result is available, an 
event is put in the queue of the engine to signal its an-ival. A further procedure "Device: Evenr 
provides a means of managing unexpected events. 

As noted above, the main loop of the run time engine is coupled to a variety of process sequencer 
units, and when the main loop encounters an appropriate event, control is temporarily transferred to 
one of the process sequencer units. 

Thus, it can be seen that the computer system implemented in the processor 20 provides a platfonn 
having considerable flexibility in enabling an application to communicate with a variety of devices. 

Returning to Figure 2. the processing of sound and image data by each of the associated processors 
will now be described in detail. In the case of received audio and video signals, the MPEG packets 
containing these signals will be demultiplexed and filtered so as to pass real time audio and video data 
in the form of a packetised elementary stream (PES) of audio and video data to dedicated audio and 
video processors or decoders 33, 34. The converted output from the audio processor 33 passes to a 
preamplifier 35 and thereafter via the audio output of the receiver/decoder. The converted output from 
the video processor 34 passes via a graphic processor 36 and PAL/SECAM encoder 37 to the video 
output of the receiver/decoder. The video processor may be of a conventional type, such as the ST 
3520 A of SGS Thomson. 
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r^^^dditionally receives graphic data for d^^w 



The graphic processor 36 additionally receives graphic data for display (such as generated images 
etc) from the central processor 20 and combines this Information wrth information received from the 
video processor 34 to generate a screen display combining moving images together with overlaid text 
or other images. An example of a graphic processor adapted to carry out this sort of operation is the 
CL 9310 of C-CUBE. 



In the case of received teletext and/or subtitle data, the conversion of the real time PES data to 
generate the appropriate images may also be handled by dedicated processors. However, in most 
conventional systems, this is handled by the general processor 20. 



In point of fact, many of functions associated with the elements such as the graphic processor 36, 
video decoder 34, central processor 20 etc, may be combined or divided out in a number of ways, e.g. 
to integrate the central and graphic processors to form a single processor means etc. 



Referring now to Figure 4, the functionality of the graphic processor 36 will now be described. As 
discussed above, the graphic processor receives and processes real time video data from the video 
decoder 34 together with graphic data received from the general processor 20 in order to generate an 
overlaid screen display. 

As shown in Figure 4, the graphic processor 36 is adapted to process input data divided into four 
distinct layers; a background layer 50. an MPEG layer 51, a graphic layer 52 and a cursor layer 53. 
As will be understood, the background layer 50 corresponds to the lowest layer of the screen display, 
the other layers being progressively superimposed with varying degrees of translucency or opacity 
over this layer. 

In the case where the decoder is configured to display a broadcast video signal, the background and 
MPEG layers 50, 51 correspond to the stream of data received from the video decoder 34» the layer 
50 corresponding to MPEG still pictures received from the decoder 34 and the layer 51 corresponding 
to a moving video MPEG signal received from the decoder. The division of a video signal into a fixed 
and a changing part is a known characteristic of MPEG compression. 



other configurations of the decoder are possible, for example, where the background and MPEG 
layers 50, 51 sre completed by picture data in any number of formats received from the processor 20. 
For example, in the case where the decoder is acting in web browser configuration, the processor 20 
may supply still and/or moving picture data to complete the layers 50. 51. The layer 50 may equally 
correspond, for example, to a background colour and the layer 51 to one or more windows displayed 
over the background and containing, for example, information, moving icons or the like. The operation 
of the system in handling picture data will be discussed in more below with reference to Figures 5 and 
6, 

Still and moving image data from the background and MPEG layers SO, 51 are mixed together by the 
graphic processor 36, as represented by the element 54, and a combined output provided. Mbcing of 
the MPEG layer information 51 over the background layer 50 by the graphic processor may carried out 
using a so-called alpha blending factor to permit a greater or lesser degree of translucency of the 
'■ pixels in the MPEG layer Image. In the case of a moving video image received from the video 
decoder 34, the same blending factor is used for all pixels within the video sequence. In the case of 
picture data fi-om the central processor 20. the value of the blending factor for the layer 51 may be 
different for different parts of the screen. 

The graphic layer 52 is used for texts, shapes, icons etc that will be displayed on the screen over the 
images taken from the layers 50. 51. for example, to permit display of a moving icon or the like 
generated by the processor 20 over a real-time video sequence taken from the video decoder 34. 

In a similar manner to the blending earned out for the layers 50. 51. the element 55 carries out a 
blending of the graphic layer 52 with the combined output of the layers 50. 51 . Different regions within 
the graphic layer 52 may be assigned a different blending factor and a corresponding different level of 
translucency depending on the characteristics Of the data within each region. 

A final layer, the cursor layer, is shown at 53 and represents an opaque cursor image, generated by 
hardware under control of the central processor 20 and superimposed over all the previous layers. As 
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shown at 56. this layer is combined with the summed output from the combination of alJ previous 
layers to generate a fina! combined output 57 sent to the encoder 37 for subsequent display. Unlike 
the previous layers, the cursor presents a continuously opaque appearance and is superimposed over 
the combined layers without any blending. 



Referring to Figures 5 and 6, the operation of a device 47 of the kind shown in Figure 3 and adapted 
to decompress and display downloaded picture images in the MPEG layer 51 will now be described. 
In the following description, the term picture is used to describe a compressed digital image. Typically, 
the sorts of picture fomnats used may include MPEG still picture, JPEG format picture, PNG format 
10 picture. GIF format picture, etc. 

Whilst the following description will concentrate on the processing and display of a single picture, a 
sequence of still pictures may be displayed one after the other in order to generate a moving image 
Sequence. 



Referring to Figure 5, downloaded compressed picture data 60. 61, 62 is initially stored in a buffer 
section of the RAM memory of the decoder indicated at 63. This buffer memory may be of a type 
initialised and managed by a high level application 43 responsible for decoding and displaying images, 
or an area of memory handled by the device manager 48 shown m Figure 3. 



Each type of picture file or group of picture files includes a header indicating the picture file format 
(GIF. MPEG, etc.) as well as the information needed to decompress the picture file. For example, a 
GIF format file 62 comprising more than one picture has a global header describing the size of the 
overall area where the two decompressed images will be displayed and a specific header for each 
25 picture describing its size and location coordinates within the overall area. 

Folipwing downloading of a compressed picture into the buffer section 53 of the memory, a 
decompression of the picture data will be effected by the device in response to a command 
PICTURE_DECOMPRESS received from tlie application. The subsequently decompressed image 
30 data v63, 64. 65 is stocked in a separate storage section of the RAM memory indicated at 66 and 
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reserved for image data eventually to be displayed in the MPEG layer. Each decompressed image or 
image sequence is given an image identity reference Id1, Id2, Id3 by the device, this ID value being 
supplied to the high level application and used for all subsequent operations to be carried out on this 
data. 

Unlike the compressed picture data temporarily held in the application buffer 63, the decompressed 
image data as, 64, 65 may be held indefinitely in the storage memory 66 until such time as the 
application decides to delete the information. 

The storage of decompressed image data in a distinct assigned memoiy area permits the data to be 
manipulated in a number of ways prior to display. For example, a resizing of the image may be 
carried out. either by the device itself, the device manager or by a higher level application. Equally, 
the image may be duplicated in order to be displayed at a number of positions on the screen. 
Conversion of colour data associated the image, for example to compensate for limitations in the 
functionality of the graphic processor, may also be carried out on the image. 

Modified or unmodified data stored in the memory 66 is passed, in response to a command 
PICTURE_DISPLAY from the application, into a separate RAM memory section 67 assigned for 
images to be displayed in the MPEG layer 51 (see Figure 2). The size of the display memory 67 
corresponds to the screen area. As shown, the images Id1 and ld2 are displayed at 58 and 69» whilst 
the image or sequence of images Id3 is duplicated and displayed at the positions 70. 71. The 
information in the memory section 67 is fed to the graphic processor 36 in order to create the MPEG 
layer 51 , as shown in Figure 2, 

in addition to the transfer of image Information between the storage area 66 and display area 67, a 
second transfer may also be canied out to copy information held in the storage area 66 into a memory 
area (not shown) associated with the display of images in the background layer 40 of Figure 2. For 
example, a single image may be replicated and displayed a number of times in the background layer 
in order to cover the screen in a tiling manner. The information stored in the memory area associated 
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with the background ia^^^ accessed by the graphic processor ir^^^same manner as the MPEG 
display area 67. 

As will be understood, the memory sections 63. 64. 65 do not need to physically correspond to 
5 uninterrupted memory zones in a single RAM or other memory element. In particular, the memory 
area 63 may be divided between a number of buffers. Figure 6 shows the steps associated with the 
decompression of a file 80 containing two compressed pictures 81. 82 previously downloaded into four 
associated buffer elements or lists of buffers 83. 84, 85, 86. 

10 Each buffer list corresponds to the buffer areas in which a block of data has been downloaded from 
the MPEG stream. The buffer list itself may designate a number of separate buffer areas depending 
on availability as the information is downioaded. 

At step 87, the application sends a PICTUR£_DECOMPRESS command 87 to start the 
15 decompression process. The device allocates a group image Id and starts read the buffers/ Once the 
start of a picture is found at step 88, the device assigns an image Id and starts decompression of the 
image. At step 89. the end of the first buffer list is reached and the application sends a 
PICTURE_ADD_DATA command at step 90 to command the device to read the next buffer list in the 
series. 

20 

At this point, only part of the image of the first picture 81 has been decompressed and stored in the 
memory storage area 66, The application may nevertheless decide to immediately transfer the partial 
image to the display memory area 67. 

25 The decompression of the remaining part of the picture 81 then continues until the start of the next 
picture is found at 91. At this point, the whole of the first picture 81 has been decompressed and 
stored in the memory area 66. The application may then update the contents of the display memory 
area 67 by copying the complete image into the display area 67. In this way, the whole of the first 
picture 81 may be displayed before the second picture has been decompressed. 
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At step 92. the device informs the application of the end of the second buffer list 84 and the application 
sends a second PICTURE_ADD_DATA command 93 to start the reading of the next buffer list 85. 
The process is repeated at the end of the third buffer list 85 and beginning of the fourth buffer list 86 
by the steps 94, 95. Again, each time the end of a buffer is reached at 92, 94. the application may 
copy the data that has already been decompressed from the storage area 66 into the display area 67. 

At step 96, the end of the file is reached and both the pictures 81. 82 have been decompressed and 

lucaJcd lulu Uic :>luicjyc: jMcmwiy 00, AL lln';^ puiul, II ic Ucviuc infuiiiia ii (« appliuaUun uf Liie :?ucce55ful 

decompression of the whole file and the application again copies the contents of the storage memory 
66 Into the display memory 67 to display the complete set of pictures. 
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CLAIMS 



1 . A decoder for a digital audiovisual transmission system, the decoder comprising a processor means 
5 for decompressing and displaying compressed digital picture data and a memory means, 
characterised in that the memory means comprises a storage memory allocated to receive 
decompressed digital image data from the processor means and at least one display memory 
readable by the processor means prior to display, data being copied from the storage memory to the 
display memory for subsequent display. 



2. A decoder as claimed in claim 1 in which the digital image data copied from the storage memory 
into the display memory is modified or duplicated during the copying step. 

3. A decoder as claimed in claim 1 or 2 in which the processor means is adapted to process image 
15 data in the display memory as one layer amongst a plurality of layers superimposed one over the 

other when displayed. 

4. A decoder as claimed in claim 3 in which the processor means is adapted to display the image data 
in the display memory in a layer nonnally used by the processor means to display broadcast 

20 audiovisual information. 

6. A decoder as claimed in any preceding claim in which the memory means comprises a second 
display memory readable by the processor means and corresponding to a second layer of displayed 
image data, data being copied from the storage memory to the second display memory for subsequent 
25 display in the second layer of image data, 
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6. A decoder as claimed in claim 5 in which the digital image data copied from the storage memory to 
the second display memory is modified or duplicated during the copying step. 




7. A decoder as claimed in any preceding claim, in which partial image data is copied from the storage 
memory to a display memory so as to permit display of part of an image. 

8. A decoder as claimed in any preceding claim, in which image data is copied from the storage 

5 memory into a first or second display memory under control of a high level application running on the 
processor means. 

9. A decoder as claimed in any preceding claim, in which compressed digital picture data is stored in a 
buffer memory means prior to decompression by the processor means. 

10 

10. A decoder as claimed in claim 9. in which the buffer means comprises a plurality of buffer memory 
elements, 

1 1 . A decoder as claimed In claim 10, In which the decompression and transfer of image data from the 
15 buffer memory elements to the storage memory, and from the storage memory to a display memory, is 

controlied by the processor means such that image information present in the storage memory is 
transferred to the display memory at the end of the decompression of the contents of each buffer 
element, 

20 12. A decoder as claimed in any preceding claim, in which the decompression and transfer of a group 
of images in a single image file from the buffer memory means to the storage memory, and from the 
storage memory to a display memory, is controlled by the processor means such that image 
information is transfen-ed from the storage memory to the display memory at the end of the 
decompression of each image in the image file. 

13, A decoder as claimed in any preceding claim, in which the processor means is adapted to 
decompress picture data sent in a compression standard that uses a colour look-up table. 
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14. A decoder as claimed tn any preceding claim, in which the processor means is adapted to 
decompress picture data sent in a compression standard that uses a red/blue/green colour value 
associated with each pixel. 



15. A decoder as claimed in any preceding claim in which the processor means comprises a general 
processor for decompressing digital picture data and a graphic processor for preparing the 
decompressed data for display. 

16. A method of digital image processing in a decoder for a digital audiovisual transmission system, 
the decoder comprising a processor means for decompressing and displaying compressed digital 
picture data characterised in that decompressed digital image data from the processor means is 
transmitted to a storage memory and thereafter copied from the storage memory to a display memory 
and read by the processor means for subsequent display. 



ABSTRACT 

PROCESSING OF DIGITAL PICTURE DATA IN A DECODER 

A decoder for a digital audiovisual transmission system, the decoder comprising a processor means 
for decompressing and displaying compressed digital picture data and a memory means 66, 67 
characterised in that the memory means 66. 67 comprises a storage memoiy 66 allocated to receive 
decompressed digital image data from the processor means and at least one display memory 67 
readable by the processor means prior to display, data being copied from the storage memory 66 to 
the display memory 67 for subsequent display. 
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